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PACS 05. 40. -a - Fluctuation phenomena, random processes, noise, and Brownian motion. 
PACS 02 . 30 . Yy - Control theory. 

Abstract. - It was recently shown that the use of feedback control can improve the performance 
of a flashing ratchet. We investigate the effect of a time delay in the implementation of feedback 
control in a closed- loop collective flashing ratchet, using Langevin dynamics simulations. Surpris- 
ingly, for a large ensemble, a well-chosen delay time improves the ratchet performance by allowing 
the system to synchronize into a quasi-periodic stable mode of oscillation that reproduces the 
optimal average velocity for a periodically flashing ratchet. For a small ensemble, on the other 
hand, finite delay times significantly reduce the benefit of feedback control for the time-averaged 
velocity, because the relevance of information decays on a time scale set by the diffusion time of 
the particles. Based on these results, we establish that experimental use of feedback control is 
realistic. 
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Introduction. — Flashing ratchets rectify the ther- 
mal motion of diffusive particles by exposing them to a 
time-dependent, spatially periodic and asymmetric poten- 
tial [1-5]. These systems are attracting significant inter- 
est [6] because they may be applied, for example, in parti- 
te separation [7, 8] or as a power source for polymer mo- 
tors [9]. In addition, flashing ratchets are one of the sim- 
plest realizations of Brownian motors in general [5], and 
are therefore of fundamental interest in non-equilibrium 
statistical mechanics and as models for synthetic [10] or 
biological [11] molecular motors. 

In most studies of flashing ratchets, the potential is 
switched periodically or randomly, without regard to the 
particle distribution. Recently, a flashing ratchet with 
feedback control was introduced, where the external po- 
tential depends on the state of the system [12]. The instan- 
taneous center-of-mass velocity was maximized by turning 
the potential on only when the ensemble- averaged force 
exerted by the potential would be positive. This strat- 
egy maximizes the time-averaged center-of-mass velocity 
for one particle (TV = 1) and performs better than a pe- 
riodically flashing ratchet for N < 10 2 — 10 3 . However, 
because fluctuations are needed to trigger the next switch- 
ing event, the time- aver aged velocity goes to zero for large 
N where center-of-mass fluctuations become rare. In an 
improved feedback strategy [13], the potential is switched 
on (off) whenever the average force increases (decreases) 
through set thresholds, eliminating the need to wait for 



fluctuations. This protocol performs as well as the feed- 
back strategy in [12] for N = 1, and yields approximately 
the same current as optimal periodic flashing for large TV. 

In an experiment designed to implement such feedback 
strategies, there will be a finite time lag between the col- 
lection of information and any feedback to the system be- 
cause of the time it takes to acquire an image of particles, 
and to determine the particle positions and ensemble aver- 
ages. Delayed feedback has been demonstrated to produce 
complicated dynamics in chaotic, inertial ratchets [14-16], 
stochastic systems that display a Hopf bifurcation (oscil- 
latory instability) in the absence of delay [17] and biolog- 
ical systems [18-20], and some analytical methods have 
recently been developed to study time delay in stochastic 
systems [21-23]. Here we study the impact of time de- 
lay on the effectiveness of the feedback control strategy 
introduced in [12]. 

For a small number of particles (less than TV « 300), 
we find that finite delay times in the feedback signifi- 
cantly reduce the average velocity, because the quality 
of the collected information decays on the scale of the 
system's characteristic diffusion time. This is consistent 
with the result [24] that loss of information about the 
system limits the improvement of the flux for the feed- 
back ratchet strategy in [12] over a periodically flashing 
ratchet. On the other hand, for the quasi-deterministic 
case of TV > 10 2 — 10 3 , we find that a well-chosen de- 
lay time effectively reproduces the advantageous thresh- 
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old protocol in [13] even though no threshold criterion is 
actually used in the algorithm. As a result, a time delay 
in the control strategy of [12] surprisingly can increase the 
average current. Somewhat paradoxically, the system is 
found not only to tolerate, but actually to benefit from 
the experimental "handicap" of finite time lags. 

Model. — We consider the following one-dimensional 
system discussed in Cao et. al. [12]: An ensemble of TV 
non-interacting, overdamped particles is exposed to a spa- 
tially periodic, piecewise linear 'sawtooth' potential V(x), 
characterized by the spatial period, L, height Vb, and 
asymmetry a (Fig. 1). The motion of the particles is de- 
scribed by the Langevin equations: 

1 x i (t) = a(t)F(x i (t))+t i (t)- i = l,...,N (1) 

where Xi(t) is the position of particle z, 7 is the drag co- 
efficient of a particle, and is a randomly fluctuating 
Gaussian white noise term with zero mean and correlation 
(Ci(t)Cj(t')) = ^lkT5ij5{t-t'). The external force is given 
by F(x) = —V f (x), and a(t) is a control parameter which 
can take the value of 1 or 0, thus switching the external 
potential on or off. 

In [12], the following two control strategies are com- 
pared: 

(1) Periodic switching: a(t + r) = a(t), with a(t) = 1 
for t e [0,r/2), and a(t) = for t E [r/2,r). 

(2) Controlled switching (maximization of the instanta- 
neous center-of-mass velocity): 

a(t) = e(/(t)), (2) 

where 

1 N 

i 

is the ensemble average of the force the particles would 
feel if the potential were on, and &(y) is the Heaviside 
function, Q(y) = 1 if y > and otherwise. 

Here, we consider two distinct types of time delay in the 
feedback control (Fig. 2): 

(1) Implementation time, t\: If a measurement is taken 
at time t, any feedback (i.e. a possible change in poten- 
tial) based on this measurement will occur at time t + t\. 
This type of delay is caused by data processing in an ex- 
periment. 

(2) Measurement interval, If a measurement is taken 
at time t, the next measurement will be taken at time 
t + £2 • This type of delay could be due to a limit in the 
readout rate of a camera system which acquires images of 
the particle distribution. 

We use Langevin dynamics simulations to study the ef- 
fect of these time delay parameters on the average parti- 
cle velocity achieved by the control strategy described by 



eq. 2. In the presence of time delay, the motion of the 
particles is given by 

7ii(t)=P(t)F(x i (t))+^ i (t) ] i = l,...,N (4) 

where /3(t) is the actual state of the system based on a de- 
layed response to the cue a(t). In all simulations, kT = 1, 
fcT/7 = D = 1, L = 1, and a = 1/3. We will use V = 5kT 
unless otherwise stated. The finite time step, dt, in a 
Langevin dynamics calculation introduces an unintended 
measurement delay £2 ? but by choosing a sufficiently small 
dt, we can examine the behavior of the system in the £2 = 
limit (for example, for N = 1, we use dt = 10 -6 L 2 /D). 
To measure ratchet performance, we calculate the time- 
averaged center-of-mass velocity, vqm — (%cm)- We have 
tested that vcm does not depend on the initial distribu- 
tion, when averaged over a long enough period of time. 

Results. — We begin by considering the effect of im- 
plementation delay, ti, with zero measurement interval 
fa = O)^ an d show in fig. 3 vqm as a function of t\ for 
different TV. The impact of implementation delay on feed- 
back effectiveness depends on the ensemble size as follows: 

Small TV: For TV = 1 and perfect feedback fa = 0), 
we reproduce the result vcm — 4.27 D/L [12], an order 
of magnitude faster than the velocity v opt « 0.284D/L 
for optimal periodic flashing without feedback for all TV 
(r = r op t ~ 0.1I/ 2 /D). However, the velocity decreases 
very quickly with t\\ for TV < 10 3 , vcm drops below 
v opt for delay greater than t x w 0.03 - 0.05L 2 /D (fig. 3). 
This time scale is reasonable when one considers that the 
distance, \JlDt^ a particle diffuses during t = 0.05L 2 /D 
is about 0.3L, comparable to the ratchet's critical length 
scale of aL. In other words, for small iV, the implementa- 
tion delay at which the feedback strategy loses effective- 
ness is comparable to the correlation time between mea- 
sured and actual particle positions with respect to the po- 
tential features. 

Large TV; small t\i As the number of particles in- 
creases, center-of-mass fluctuations become more rare, and 
the time-evolution of the ensemble becomes more deter- 
ministic. Thus, for larger ensembles, the effect of a short 
implementation delay t\ can be visualized by inspecting 
the characteristic time development of f(t) for N = 10 6 
(fig. 4). Initially, the potential is on and the particles are 
equilibrated, so that / « 0. A fluctuation that yields 
/ < produces a cue to turn the potential off (set- 
ting a(t) to zero), which is implemented a time t\ later 
(/3(t) = a(t — t\) for £2 = 0)- This leads to a rapid de- 
crease of / because half of the particles quickly diffuse into 
an area with a large negative force. Rapid shifts in / occur 
for a duration of about £1, as (3(t) switches in response to 
previous cues. Once f3 = becomes steady, the system ap- 
proaches its new equilibrium state. Near the new equilib- 
rium, a center-of-mass fluctuation yields / > 0, and after 
a delay of t\ the potential is turned on, rapidly pushing 
the particles down the potential slopes (the steeper slope 
is cleared first, yielding an initial increase of /). Again, 
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fluctuations in / are observed for a duration of about t\ 
before (3 = 1 becomes steady. For small ti, the velocity 
is reduced due to the additional time spent near equilib- 
rium before a cue is implemented and the unproductive 
fluctuations in / after the potential is switched. 

Large TV; large t\\ For large TV, we find that a fi- 
nite value of t\ can be chosen such that vcm surpris- 
ingly is larger than in the absence of time delay. This 
result is initially unexpected because for TV > 10 3 , vqm 
achieved by the feedback mechanism used here (eq. 2) falls 
short of v op t, even without the experimental handicap of 
finite implementation delay [12]. To understand how im- 
plementation delay can actually improve the performance 
of a feedback mechanism, note that f(t) essentially be- 
comes deterministic for large TV. As shown in fig. 4(b), 
for t\ = 0.09L 2 /D, after a small number of initial cycles, 
a cue created in one cycle of the potential correctly trig- 
gers a switching event in the next cycle. This mode is 
stable when t\ is larger than the duration of the initial 
transient toward the maximum |/| that is observed af- 
ter each switching event, because a potential switch after 
the system moves through the maximum |/| will trigger 
a sign change of /, and thus a new cue. For the param- 
eters used here, the maximum |/| is reached after about 
0.03L 2 /D, which is consistent with our observation that 
vcm increases with t\ for TV > 10 3 when t\ > 0.03L 2 /D. 

A key result of this paper is that, for a large enough 
ensemble, there is a range of implementation delays that 
improve the performance of a feedback-controlled ratchet 
by allowing the system to synchronize into a stable mode 
of oscillation that does not rely on fluctuations to trigger 
a change in the potential. If t\ is longer than the initial 
approach to the maximum |/| in the characteristic time- 
evolution of / (t\ > 0.03L 2 /D), then a cue created in 
one cycle can trigger a switching event in the next cycle. 
This produces a stable mode of oscillation with a period 
of about r = t x (fig. 5(b)). Thus, for t x « r opt = 0.1L 2 /L>, 
the system operates at v opt (Fig. 5(a)). The inset of 
fig. 5(a) shows that this behavior is qualitatively indepen- 
dent of Vb, noting that v opt is itself a function of Vq. For 
increasing Vb, v opt (Vo) is reached for smaller ti, because 
less time is required for the particles to localize in the po- 
tential, decreasing the implementation delay necessary to 
achieve v C m = v opt (V ). 

Interestingly, for even larger t\ (we investigated up to 
t\ = 0.5L 2 /D), the system usually finds a mode in which 
cues are implemented multiple periods in the future. In 
this case, it can take hundreds of cycles for the system to 
stabilize in this mode of operation. As seen in fig. 5(b), 
for values of t\ such that a cue is implemented after two 
cycles (at around t\ > 0.16L 2 /D), the stable period is 
r « ti/2. Near the boundary between two modes, the 
system can synchronize into either mode. In the range of 
t\ = 0.13 — 0.18L 2 /D, the system has been observed to 
become metastably synchronized into one quasi-periodic 
mode for several hundred cycles before locking into the 
other mode (for example, see inset to fig. 5(b)). For TV — 



10 6 , we observe these stable modes for at least 10 4 cycles, 
and one can expect that periodic modes of oscillation will 
always remain stable in the deterministic limit of large TV. 

Measurement delay: The synchronized behavior dis- 
cussed above relies on the arrival of one cue triggering a 
new cue of the same sign. We now examine the impact 
of a finite measurement interval, on this synchroniza- 
tion, for several values of relative to t\. For TV = 10 6 
(fig. 6(a)), broadly speaking, we observe two regimes of 
behavior: (1) For < ti, we see qualitatively the same be- 
havior as for £2=0, except that the velocity versus t\ be- 
havior shifts to smaller t 1? because increasing £ 2 increases 
the period of the synchronized cycles. If £2 is n °t close to 
being an integer multiple of £1, for example £2 = ti/2, v opt 
is not achieved because a new measurement is taken before 
the previous measurement has been implemented, which 
interferes with the synchronization necessary to produce 
optimized periodic flashing. (2) For t 2 > t 1? a new cue is 
sent after the force has switched signs in response to the 
previous cue, so the synchronization-induced increase in 
the average velocity with t\ does not occur. 

On the other hand, for small TV, the velocity decreases 
with t\ for any value of £2 (shown for TV = 10 in fig. 6(b)), 
because increasing t\ decreases the level of correlation be- 
tween the particle distribution when the cue is taken and 
when it is implemented. Interestingly, for < t<i < t\, the 
falloff in velocity with respect to t\ is not as steep as when 
£2=0 for the following reason: A finite measurement in- 
terval £2 allows the ensemble to evolve before the next 
cue is taken, which decreases the amount of unproductive 
rapid oscillations. For £2 > h, the velocity is slower than 
when £2=0, because there is idle time in each cycle before 
a new measurement is taken. 

Experimental feasibility. — To place the time scales 
discussed here into a quantitative context, consider a pos- 
sible experimental implementation that uses an interdig- 
itated electrode array to expose charged, colloidal parti- 
cles such as carboxylate-modified, fluorescent polystyrene 
beads to a time-dependent, asymmetric, electrostatic po- 
tential. Such flashing ratchet devices have been used pre- 
viously with DN A molecules [7] . A feedback operation in 
such a system will require: (I) acquisition of a 2D image 
using a CCD camera; (II) numerical determination of par- 
ticle locations; (III) decision whether to switch the poten- 
tial; and (IV) change of voltage applied across the array. 
The total time for operations (I) - (IV) corresponds to t\ 
in fig. 2. The camera exposure time (step I) often limits 
the rate at which images can be acquired and corresponds 
roughly to t<i in fig. 2 1 . 

For small TV, fig. 3 shows that to fully benefit from feed- 
back, delay times should be kept below about 0.01L 2 /D. 

lr rhe correspondence between exposure time and as denned in 
fig. 2 is not exact because, in an experiment, particle positions are 
averaged over the exposure time, whereas in our numerical studies 
particle positions are collected instantaneously at the end of £2- Nev- 
ertheless, our general discussion of relevant time scales holds true. 
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Feedback schemes to control the position of a single, flu- 
orescent particle have been implemented with rates up 
to 300 Hz [25]. If we assume t\ ~ 10ms for small N, 
then ti < 0.01L 2 /D when L > 1.2/ira for beads of di- 
ameter d = 300nm in an aqueous environment (viscosity 
r] = 10" 3 Pa- s, D = kT/3irr]d). In other words, for iVwl, 
a ratchet with L « lfim or larger could yield almost the 
full theoretical benefit of feedback. Electrodes of this size 
can easily be fabricated using standard lithography. 

The rates quoted above are accessible when a small sub- 
set of the CCDs pixels are used. For N « 10 2 - 10 3 , a 
full-size (for example 512 x 512) image would be needed, 
yielding a typical exposure and readout time from a high- 
sensitivity CCD camera of about 30ms. Ideally, opera- 
tions (II)- (IV) are performed while the next image is col- 
lected by the camara, such that total delay times of order 
ti = 2^2 ~ 60ms are realistic. To observe the effect of 
feedback delay on ratchet transport shown in Fig. 6, it 
is desirable to vary t\ across the range 0.01 — 0.1L 2 /D. 
For delay times on the order 60ms, one therefore requires 
L 2 /D & Qs. For beads of diameter d in an aqueous envi- 
ronment exposed to a ratchet potential with L = 3/im, we 
find L 2 /D = 6s for d = 290nra. 

The time scale L 2 / D scales linearly with d for fixed 
L and can thus easily be adjusted by changing the par- 
ticle size. If locating individual particles is either too 
slow or limited by image resolution, it should be possi- 
ble to establish the desired feedback protocols by mea- 
suring density distributions. The effects demonstrated 
above numerically are most clearly observable for poten- 
tial depths of several kT or more. In water, commercially 
available 300nm carboxylate-modifled polystyrene beads 
have a charge q « 10 5 e, so an electrostatic potential in the 
lOOmV range should create a trapping strength qV much 
greater than kT. It therefore appears realistic in principle 
to experimentally explore the key results presented here. 

Concluding remarks. — In conclusion, we estab- 
lished that an implementation delay on the order of the 
diffusion time over the length of the negative-slope por- 
tion of the ratchet potential significantly compromises the 
performance of a feedback-controlled flashing ratchet for 
small particle numbers (fewer than w 300). However, we 
found that for larger particle numbers, an implementation 
delay actually improves the performance of the feedback 
strategy introduced by Cao et al. [12], and matches the 
performance of an optimally periodic potential modula- 
tion, similar to the feedback mechanism discussed in [13], 
even for surprisingly long delay times. 

We have demonstrated that this key result is true in 
general for < t\, independent of the potential depth 
and the initial conditions. We expect that the transition 
between the ('nondeterministic') low TV behavior and the 
('deterministic') high N behavior is weakly dependent on 
Vq. For the relevant case of potential depths of several 
kT or more, increasing the potential will have minimal ef- 
fect on how deterministic the system is, and the transition 
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Fig. 1: The applied ratchet potential V(x), shown in the 
schematic above, is characterized by periodic length L, height 
Vb, and asymmetry a. 

between 'low TV' and 'high TV' regimes will depend most 
critically on the behavior of the ensemble when the po- 
tential is off. We have modeled the role of time delay in 
feedback control of a ratchet over a range of parameters 
that would be feasible to implement experimentally. 

Note: After submission, two preprints [26,27] came to 
our attention, which use a combination of numerical and 
analytical methods [21] to study the role of implementa- 
tion time delay in a flashing ratchet. 
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Fig. 2: The schematic above illustrates the two types of time 
delay in feedback strategies: If a measurement is taken at time 
t, the feedback based on this measurement will be implemented 
at time t-\-t\ (implementation delay). The next measurement 
will be taken at time £ + £2 (measurement interval). 
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Fig. 3: Langevin dynamics simulations, (a) Average velocity 
as a function of £1, for £2 = and different N as indicated. 
The lines between data points are included as a guide to the 
eye. The horizontal, dashed line shows the average velocity 
for switching with optimal period r op t = 0.1L 2 /D. (b) An 
enlarged view of (a) for small vcm- Error bars are shown for 
N = 1. For N > 10, the error is smaller than 0.1% of the 
values of vcm displayed. 
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state, a(£) (cue) and the implemented state, f3(t) (response) 
are shown above. The red arrows indicate the delay between 
cue and response. Initially, the potential is on, and particles 
are equilibrated in this potential, (b) N = 10 6 , £1 = 0.09L 2 /D, 
and £2 — 0. 
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Fig. 5: Langevin dynamics simulations (N = 10 6 data from 
fig. 3). (a) Average velocity as a function of £i, for £ 2 = 
and iV = 10 6 . The lines between data points are included as a 
guide to the eye. The dashed line shows the average velocity, 
v op t, for optimal periodic switching. Inset: Average velocity 
as a function of t\ for three different Vb, each normalized by 
the v op t corresponding to that Vb with a = 1/3. (b) Average 
temporal period of stable oscillations as a function of £i, cal- 
culated using the same simulated data as in (a). The dashed 
line corresponds to r op t- The slope of lines through the data 
points are characteristic of different modes of quasi-periodic 
stable oscillations. Data points for t\ > 0.03L 2 /D either fol- 
low r — ti, which means that a cue created in one cycle triggers 
a switching event in the next cycle, or r = £i/2, which means 
that a cue in one cycle is implemented after two cycles. Inset: 
Example of a transition from a metastable to a stable mode, 
for ti = 0.13L 2 /L>. 
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Fig. 6: Langevin dynamics simulations, (a) Average velocity 
as a function of t\ for N = 10 6 . There are two regimes with 
qualitatively different behavior, £2 < £1 and £2 > £1, as dis- 
cussed in the text, (b) Average velocity as a function of £1 for 
N = 10, for several choices of £2/^1 • The lines between data 
points are included as a guide to the eye. 
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